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Abstract — In this paper, we propose a new redundant wavelet 
transform applicable to scalar functions defined on high dimen- 
sional coordinates, weighted graphs and networks. The proposed 
transform utilizes the distances between the given data points. We 
modify the filter-bank decomposition scheme of the redundant 
wavelet transform by adding in each decomposition level linear 
operators that reorder the approximation coefficients. These 
reordering operators are derived by organizing the tree-node 
features so as to shorten the path that passes through these 
points. We explore the use of the proposed transform to image 
denoising, and show that it achieves denoising results that are 
close to those obtained with the BM3D algorithm. 

Index Terms — High-dimensional signal processing, image de- 
noising, redundancy, tree, wavelet. 



I. Introduction 

Signal processing problems may involve inference of an 
unknown scalar target function defined on non-uniformly 
sampled high-dimensional grid, a graph or a network. A major 
challenge in processing functions on topologically complicated 
coordinates, is to find efficient methods to represent and learn 
them. Let X = {xi, xat} be the dataset such that G W 1 
are points in high-dimension, or feature points associated with 
the nodes of a weighted graph or network. Also, let / : X —> R 
be a scalar function defined on the above coordinates, and 
let f = [/i, . . . , /at] t , where fi = /(x^). A key assumption 
in this work is that under a distance measure w(-,-) in R n , 
proximity between the two coordinates and Xj implies 
proximity between their corresponding values fi and fj. The 
goal in this work is to develop a redundant wavelet transform 
that can efficiently represent the high-dimensional function f . 
Efficiency here implies sparsity, i.e. representing f accurately 
with as few as possible wavelet coefficients. 

In our previous work [1], we have introduced the gen- 
eralized tree-based wavelet transform (GTBWT), which is 
a critically sampled (in fact, unitary) wavelet transform ap- 
plicable to functions defined on irregularly sampled grid of 
coordinates. We have shown that this transform requires less 
coefficients than both the one-dimensional (ID) and two- 
dimensional (2D) separable wavelet transforms to represent an 
image, and is useful for image denoising. The main limitation 
of the GTBWT is sensitivity to translation. Indeed, in order to 
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obtain a smooth denoising result in [ 1 ], we utilized a redundant 
representation obtained by applying several random variants of 
the GTBWT to the noisy image. This approach is effectively 
similar to applying a redundant transform to the image in a 
rather cumbersome and computationally intensive manner. 

In this paper, we introduce a redundant tree-based wavelet 
transform (RTBWT), which extends the redundant wavelet 
transform fl2), (3), (4), 0, to scalar functions defined 
on high dimensional data clouds, graphs and networks. This 
transform is obtained by modifying an implementation of 
the redundant wavelet transform, which was proposed by 
Shensa [5\ and Beylkin [6], similarly to the way we modified 
the decomposition scheme of the orthonormal transform in 
lED . This implementation employs a filter-bank decomposition 
scheme, similarly to the orthonormal discrete wavelet trans- 
form. However, in each level of this scheme none of the 
coefficients are discarded. We add in each decomposition level 
linear operators that reorder the approximation coefficients. 
These operators are data-dependent, and are obtained using 
tree-like structures constructed from the data points. Each 
reordering operator is derived by organizing the tree-node 
features in the corresponding level of the tree so as to shorten 
the path that passes through these points. The reordering op- 
erators increase the regularity of the permuted approximation 
coefficients signals, which cause their representation with the 
proposed wavelet transform to be more efficient (sparse). 

We explore the use of the proposed transform to image 
denoising, and show that it outperforms the algorithm pro- 
posed by Elad and Aharon (7), (8) which is based on the K- 
SVD algorithm (9), fTOlh and achieves denoising results that 
are similar to those obtained with the BM3D algorithm |[TT1l . 
We also show that the RTBWT and GTBWT achieve similar 
denoising results, while the former is computationally less- 
demanding. 

The paper is organized as follows: In Section II, we in- 
troduce the proposed redundant tree-based wavelet transform. 
In Section III, we explore the use of this transform to image 
denoising, and present experimental results that demonstrate 
its advantages. We summarize the paper in Section IV. 

II. Redundant Tree Based Wavelet Transform 

A. Decomposition and Reconstruction schemes 

We wish to develop a redundant wavelet transform that 
efficiently (sparsely) represents its input signal f , defined on 
a irregularly sampled grid of coordinates. To this end, we 
extend the redundant wavelet transform, similarly to the way 
we extended the orthonormal transform in Q. We note that 
we construct our proposed transform by modifying an imple- 
mentation of the redundant wavelet transform as proposed by 
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Fig. 1: Decomposition scheme of the proposed redundant wavelet Fig. 2: Reconstruction scheme of the proposed redundant wavelet 
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Shensa | 5 ] and Beylkin (51, and not the well known algorithme 
a trous E|, 0, 0. This implementation employs a filter-bank 
decomposition scheme, similarly to the orthonormal discrete 
wavelet transform. However, in each level of this scheme all 
the coefficients are retained since the highpass bands do not 
contain decimators, and the decimation in the lowpass bands 
is replaced by a split into even and odd sequences, which are 
further decomposed in the next decomposition level. 

Fig. [T] describes the decomposition scheme of our proposed 
redundant wavelet transform. We denote the coarsest decom- 
position level i = 1 and the finest level I = L = log 2 7V+l. a^ 
and di denote the approximation and detail coefficients in level 
I, respectively. We start with the finest decomposition level, 
&L = f, and apply the linear operator P| 1? which produces a 
permuted version 3l p l of its input vector. P\ s denotes a linear 
operator that operates in the 5th band, out of t bands, in the 
£th decomposition level, and produces a permuted version of 
its input vector. These operators make the difference between 
our proposed wavelet decomposition scheme and the common 
redundant wavelet transform 0, (6). As we explain later, 
these operators "smooth" the approximation coefficients in the 
different levels of the decomposition scheme. Next, we apply 
the wavelet decomposition filters h and g on a^, and obtain 
the vectors and d^_i, respectively. Let | 2° and | 2 e 

denote 2 : 1 decimators that keep the odd and even samples 
of their input, respectively. Then we employ these decimators 
to obtain the signals a| / _ 1 x and a|_ 1 2 . These two vectors 
are used as inputs for the next decomposition level. 

We continue in a similar manner in the following decom- 
position levels. Let &\ s denote an approximation coefficients 
vector, which is found in the sth band (out of t bands), 
in the l\h decomposition level. This vector is obtained by 
starting from the sth sample in a^, and keeping every tth 
sample. Then in the £th decomposition level we decompose 
each of the vectors {a.j s }^ =1 . We first apply on each vector 
sq s the linear operator Pf 3 and obtain a permuted version 
a £ s • W e then filter a. £ s ,p with h and g and obtain the 
vectors a^/ s and df^/ s , respectively. Finally, we employ 
the decimators | 2° and | 2 e to split each of the vectors 
{ a |_i s }s=i mt0 even anc * °dd sequences, respectively, and 
obtain the set or vectors |a|_ 1 s )^ =1 

In a similar manner, Fig. [2] describes the reconstruction 



scheme of our redundant wavelet transform, h = and 
g = T^g, where h and g denote the wavelet reconstruction 
filters, and the interpolators denoted by t 2° and t 2 e place 
the samples of their input vector in the odd and even locations 
of their output vector, respectively. Finally, the linear operator 
P\ s reorders a vector so as to cancel the ordering done by 
Pg s , i.e. P\ s = (P\ s ) _1 . We next describe how the linear 
operators P\ s are determined in each level of the transform. 

B. Building the operators P\ s 

We wish to design the operators P\ s in a manner which 
results in an efficient (sparse) representation of the input signal 
by the proposed transform. The wavelet transform is known 
to produce a small number of large coefficients when it is 
applied to piecewise regular signals El- Thus, we would like 
the operator Pj 3 , applied to a^ s , to produce a signal which 
is as regular as possible. We start with the finest level, and 
try to find the permutation that the operator P^ 1 applies to 
&l = f . When the signal f is known, the optimal solution 
would be to apply a simple sort operation. However, since we 
are interested in the case where f is not necessarily known 
(such as in the case where f is noisy, or has missing values), 
we would try to find a suboptimal ordering operation, using 
the feature coordinates x^. 

We recall our assumption that the distance w(x.i,x.j) pre- 
dicts the proximity between the samples fi and fj. Thus, we 
try to reorder the points so that they form a smooth path, 
hoping that the corresponding reordered ID signal a^ will 
also be smooth. The "smoothness" of the reordered signal a^ 
can be measured using its total variation measure 

N 

KI|y = EKW-<(i-i)l- a) 

Let {x^}^ 1 denote the points {x^}^ 1 in their new order. 
Then by analogy, we measure the "smoothness" of the path 
through the points x^ by the measure 

N 

^ = E w K'4-i)- ( 2 ) 

We note that in the case that w is the Euclidean distance and / 
is Lipschitz continuous, i.e., there exists a real constant K > 



such that 

|/(x,)-/(x,)|<jr||x,-x,|| 2 (3) 
for all and in X, then 
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which means that KC V L v is an upper bound for ||a^||y. 

Minimizing C£ v comes down to finding the shortest path 
that passes through the set of points Xj, visiting each point 
only once. This can be regarded as an instance of the traveling 
salesman problem fT2lh which can become very computation- 
ally exhaustive for large sets of points. We choose a simple 
approximate solution, which is to start from an arbitrary point 
(random or pre-defined), and continue from each point to its 
nearest neighbor, not visiting any point twice. The permutation 
applied by the operator P| x is defined as the order in the 
found path. 

In order to employ the aforementioned method to find 
the operators P^_ u and P%_i 2 in the L — 1th decom- 
position level, we again require feature points in order to 
predict the proximity between the samples of sll-i- Since 
a i-i 1 anc * a i-i 2 are obtained from &l through filtering 
and subsampling, each approximation coefficient ol_i(z) is 
in fact calculated as a weighted mean of coefficients from 
&l, where the coefficients in h serve as the weights. Thus, 
we calculate the feature point cf _1 , which corresponds to 
dL-i(i) 9 by replacing each coefficient ol(z) in this weighted 
mean by its corresponding feature point X;. We then employ 
the approximate shortest path search method described above 
to obtain the operators P^-w anc * P^-i 2 usm g me feature 
points that correspond to the coefficients in a| / _ 1 1 and a|_ x 2 , 
respectively. 

We continue in a similar manner in the following decom- 
position levels. In level t we first obtain the feature points 
cj as weighted means of feature points from the finer level 
t + 1. Then we use these feature points to obtain the operators 
Pj 8 , running the approximate shortest path searches. Simi- 
larly to the GTBWT decomposition scheme Q, the relation 
between the feature points in a full decomposition can be 
described using tree-like structures. Each such "generalized" 
tree contains all the feature points which have participated in 
the calculation of a single feature point cj from the coarsest 
decomposition level. Also, each feature point in the tree level 
t is connected to all the points in level t+1 that were averaged 
in its construction. Fig. [3] shows an example of a "generalized" 
tree, which may be obtained for a dataset of length N = 8, 
using a filter h of length 4 and disregarding boundary issues 
in the different levels. As the construction of these tree-like 
structures play an integral part in our proposed transform, we 
term it redundant tree-based wavelet transform (RTBWT). 

We also note that the computational complexities of both 
the RTBWT and the GTBWT are dominated by the number 
of distances that need to be calculated in their wavelet de- 
composition schemes. In H) we employed the orthonormal 
transforms corresponding to several randomly constructed 
trees in order to apply a redundant transform. A full RTBWT 
decomposition, corresponding to redundancy factor of L, 




Fig. 3: An illustration of a "generalized" tree. 

requires the calculation of N 2 — 2N — ^N(L — 1) + 1 distances. 
The method employed in (TJ requires L (^N 2 — N — L + |) 
distance calculations in order to obtain a transform with a 
similar redundancy factor. Therefore for large N it requires 
about |L times more distance calculations than the RTBWT. 
We next demonstrate the application of our proposed transform 
to image denoising. 

III. Image denoising using RTBWT 

Let F be an image of size N\ x N2 where N1N2 = N, and 
let F be its noisy version: 

F = F + Z. (5) 

Z denotes an additive white Gaussian noise independent of F 
with zero mean and variance a 2 . Also, let f and f be vectors 
containing the pixels of F and F, respectively, arranged in the 
same lexicographical order. Our goal is to reconstruct f from f 
using the RTBWT. To this end, we first construct the image F 6 
of size (Ni+y/n— 1) x (N2+^/n— 1) by padding F with mirror 
reflections of itself, and then extract the feature points x$ from 
F 6 . Let fi be the ith sample in f , then we choose the point x^ 
associated with it as the y/n x y/n patch around the location 
of fi in the image F 6 . Next, we obtain all the operators 
P\ s employed by the RTBWT using the scheme described 
above. We use the squared Euclidean distance to measure 
the dissimilarity between the feature points in each level, 
and restrict the nearest neighbor searches performed for each 
patch to a surrounding square neighborhood which contains 
B x B patches. This restriction decreases the computational 
complexity of the transform and our experiments showed that 
with a proper choice of B it also leads to improved denoising 
results. 

Now let Cl be a matrix of size nx N, containing column 
stacked versions of all the patches x^ inside the image. In (TJ 
we observed that improved denoising results are obtained by 
using in the denoising process all the n signals located in the 
rows of Cl . These signals are the column stacked versions of 
the n images of size N\ x N2, whose top left pixel resides 
in the top left y/n x y/n patch in the image F 6 . We apply a 

9 level decomposition to each of these subimages, and obtain 

10 coefficient matrices of size n x N. We chose to perform 
a 9 level decomposition, which corresponds to a redundancy 
factor of 10, over a full decomposition, as the former is less 
computationally and memory demanding, but produces similar 



TABLE I: Denoising Results (PSNR in dB) of Noisy Versions of 
the Images Barbara and Lena Obtained with the K-SVD (top left), 
BM3D (top right), GTBWT (bottom left) and RTBWT (bottom 
right) Algorithms. For Each Image and Noise Level the Best Result 
is Highlighted. 
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denoising results. Next, we zero in each such matrix all the 
columns whose norm is smaller than a threshold T. Note that 
this is different (and better performing), compared to the plain 
hard thresholding that is described in (T). We then apply the 
inverse transform to each subimage, plug it into its original 
place in the image, and obtain the denoised image by averaging 
the different values obtained for each pixel. 

In order to assess the performance of the proposed image 
denoising scheme we apply it with the Symmlet 8 wavelet 
filter to noisy versions of the images Lena and Barbara, with 
noise standard deviations a = 10, 25. The noisy and recovered 
images corresponding to a = 25 can be seen in Fig. |4l For 
comparison, we also apply to the two images the algorithm 
proposed by Elad and Aharon Q, O which is based on the 
K-SVD algorithm 0, d, the BM3D algorithm El, and 
the GTBWT with the search neighborhood and thresholding 
method described above. The PSNR of the results obtained 
with all the four denoising schemes are shown in Table U It 
can be seen that the results obtained with both the RTBWT 
and the GTBWT are better than the ones obtained with the 
K-SVD algorithm, and are close to the ones obtained with the 
BM3D algorithm. However, the RTBWT was about 6 times 
faster than the GTBWT since it required much less distance 
calculations. 

IV. Conclusion 

We have proposed a new redundant wavelet transform 
applicable to scalar functions defined on graphs and high 
dimensional data clouds. This transform is the redundant 
version of the GTBWT introduced in Q. We have shown 
that our proposed scheme can be used for image denoising, 
where it achieves denoising results that are close to the state- 
of-the-art. In our future work plans, we intend to: 

1) Seek ways to improve the method that reorders the 
approximation coefficients in each level of the tree, 
replacing the proposed approximate shortest path search 
method. 

2) Modify the denoising algorithm so it will adaptively 
choose the patch and search neighborhood sizes, and 
the denoising threshold. 

3) Improve the image denoising results by using two iter- 
ations with different threshold settings. 
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